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Summary  We  give  in  this  paper  the  solution  to  the  first  passage  problem 
for  a  strongly  continuous  temporally  homogeneous  Markoff  process  X(t).  ^If 
(x)  is  a  random  variable  giving  the  time  of  first  passage  of  X  (t) 
from  the  region  a  >  X(t)  >  b  iidien  a  >  X(0)  ■  x  >  b,  w  develop  simple 
methods  of  gettJj^  the  distribution  of  T  (at  least  in  terms  of  a  Laplace 


transform)..  Prom  the  distribution  of  T  the  distribution  of  the  maximum  of 

A 

X(t)  and  the  range  of  X(t)  are  deduced.  These  results  yield,  in  an  asymptotic 
form,  solutions  to  certain  statistical  problems  in  sequential  analysis,  non- 
parametric  theory  of  'goodness  of  fit,*  optional  stopping,  etc.  which^^we- 

treaWas  an  illustration  of  the  theory.  C  )  ^ - 

1.  Introduction.  There  are  certain  generalizations  of  the  classical 
gambler's  ruin  problem  which  appear  in  various  guises  in  numerous  applica¬ 
tions  —  besides  statistical  problems  there  are  physical  applications  in  the 
theory  of  noise, in  genetics,  etc.  The  exact  solution  of  the  associated  random 
walk  (or  Markoff  chain)  problem  is  often  analytically  difficult,  if  not  im¬ 
possible  to  obtain,  and  one  is  usually  content  with  asymptotic  solutions. 

The  nature  of  the  asymptotic  solution  is  generally  such  that  it  is  the 
solution  to  a  Markoff  chain  problem  in  which  the  length  of  the  steps,  and 
the  interval  between  them,  approach  zero  and  which  may  in  the  limit  be  re¬ 
garded  as  some  sort  of  continuous  stochastic  process. 


1.  The  major  part  of  this  work  was  done  while  the  authors  were 
consultants  with  The  RAND  Corporation. 
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This  clrcumstvice  auggeats  wa  might  aolve  directly  the  associated 
problem  with  regard  to  the  stochastic  process  atid  so  obtain  the  asymptotic 
solution  to  the  Markoff  chain  problem  without  the  intervention  of  a  limit¬ 
ing  process.  Aside  from  the  difficulty  of  Justifying  the  interchange  of 
these  limiting  operations!  it  turns  out  that  this  procedure  is  often  quite 
feasible  and  leads  to  simple  solutions.  Using  this  idea  Doob  Qz]]  obtained 
in  a  direct  way  the  Kolmogoroff-Smimov  limit  theorems  and  the  principle  was 
further  exploited  by  Anderson  and  Darling  .  The  general  principle  is, 
of  course!  quite  old!  and  in  connection  with  random  walk  problems  goes  back 
at  least  to  Rayleigh. 

A  general  feature  of  this  method  is  that  the  analytical  difficultiee! 
if  any!  revealed  as  more  or  lees  classical  boundary  value  problems!  eigen¬ 
value  problems!  etc.  —  this  intrinsic  nature  of  the  problem  being  often  masked 
by  the  discrete  approach.  On  the  other  hand!  it  suffers  from  the  serious  defect 
of  giving  no  information  as  to  the  difference  between  the  actual  solution  and 
the  asymptotic  one  —  information  which  is  essenti.xl  in  the  numerical  applica¬ 
tions. 

In  the  present  paper  we  treat  the  first  passage  (or  ruin!  or  absorp¬ 
tion  probability)  problem  for  a  general  class  of  Markoff  processes  (cf.  section  2) 
and  obtain  the  solution  in  the  form  of  a  Laplace  transfom  (section  3)*  This 
Laplace  transform  la  generally  given  as  a  simple  function  of  the  solutions  to 
an  ordinary  differential  equation  (section  U)»  The  methods  used  are  similar 
to  those  used  in  the  discrete  theory  by  V.'ald  (fundamental  identity)  and 

Feller  ^9^  (renewal  and  generating  function  techniques)  but  the  analysis  is 
considerably  simplified!  at  least  in  a  formal  way!  restricted  to 


additiv*  procasBM*  It  turns  out  that  there  is  an  Intio/tte  relationship 
between  the  one  and  two  sided  absorption  probabilities,  and  the  probability 
of  eventual  absorption  in  one  of  the  boundaries* 

We  illustrate  the  theory  in  section  5  by  solving  a  problem  of  Wald 
Q.73  in  the  sequential  test  of  the  mean  of  a  nonaal  population  against  a  single 
alternative,  the  derivation  of  a  non-parametric  test  used,  by  Anderson  and 
Darling  and  the  solution  to  the  optional  stopping  problem  (Robbins  Q.0  )• 
These  problems  are  treated  by  solving  the  asrociated  absorption  problem  with 
the  Wiener-Einstein  process  and  the  Uhlenbeck  process* 

In  section  6  we  study  the  first  passage  moments  which  can  be  obtained 
by  an  expansion  of  the  Laplace  transforms  or  again  through  differential  equa¬ 
tions  which  can  be  explicitly  solved  in  quadratures.  There  are  some  quite 
interesting  relations  between  the  mooents* 

In  section  7  we  develop  the  distribution  of  the  range  which  has  been 
useJ  by  Feller  [icQ  in  a  statistical  study* 

2*  Definitions,  notations .  assumptions,  etc.  Given  a  stochastic  process 
X(t)  with 

X(0)  -  X  ,  a  >  X  >  b 

we  define  the  first  passage  time  T^],(x)  as  the  random  variable 


We  make  the  following  aBJumptions  about  the  stochastic  process  X(t): 

A)  X(t)  has  a  tranaition  probability 

P(x  I  y,  t)  -  kr  |x(t^3)  <  y  I  X(s;  -  X  j  ,  s  >  0 
satisfying  the  Chapman-Kolmogoroff  equation 

I  y>  ^  I 

-  00 

t,  >  0,  t  >  0 

i.e.  X(t)  is  temporally  homogeneous  and  stochastically  definite 
(e.g.  Markoffian) 

B)  X(t)  is  continuous  with  probability  one  (or  is  stron/^ly  continuous ) . 

If  X(t)  satisfies  A)  sufficient  conditions  on  P  aro  known  that  it 
satisfy  B)  -  cf.  Doeblin  ([5]  »  Fortet  »  Ito  [12]  .  These  conditions 
generally  imply  further  that  P  satisfies  the  diffusion  equation  of  section  /*, 
Note  that  A)  and  B)  imply  the  existence  of  the  random  variable  T,  and  we  denote 
by  (x  I  t)  the  distribution  function  of  T 

In  the  work  to  follow  we  shall  presume  P  and  F  have  derivatives  p,  f; 


these  being  the  densities 


p(x|  y.  t)  •  ^  P(»l  y#  t) 


the  modification  of  the  results  if  these  conditions  are  not  met  being  more 

or  less  iasediate.  The  existence  of  a  density  for  T  has  been  established 

by  Fortet  [ll]  under  some  circ^tances.  In  this  ^\lndamental  paper  of 

Fortet  on  absorption  probabilities  there  is  Just  one  absorbing  barrier,  but 

the  modification  of  his  results  for  two  barriers  is  easy. 

Ifa*'‘^ao  orb«>oo  so  that  we  have  a  one  sided  absorption  tine 

we  write  T^(x)  as  the  corresponding  random  variable.  That  is 
c 


T^(x)  - 


T  (x)  if  X  <  c 

C,—  00 


with  a  corresponding  distribution  function  F  (x  1 1)  and  density  f  (x|  t). 

It  may  happen  of  course  that  absorption  is  not  a  certain  event  and 
that  T  is  nofa  proper  random  variable  -  i.e.  Pr  |oo)  <  1 

(or  similarly  for  )  and  in  this  case  we  may  still  meaningfully  treat  the 

conditional  density  of  T,  under  the  condition  T  <  oo. 

We  need,  in  addition,  the  conditional  distribution  of  under  the 

condition  that  the  absorption  takes  place  into  the  barrier  £,  which  we  denote 
by  F*^  (x|  t) 
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F^b  (X  1 1)  .  Pr  [T^b^*)  <  «•  . 

and  I  t)  will  denote  a  sioilar  expression  for  the  lower  barrier 

Hence 

■  ‘'lb  I  *  ^Ib  I 

and  the  corresponding  densities  are  (x  1 1)  and  (x  |  t). 

We  denote  by  a  circiiaTlex  over  the  corresponding  function  Its 
Laplace  transform  on  tj  for  example 

p(x  I  y#  ^)  ■  /  P(x  I  y,  t)  dt 
0 

f*b(*  I  >■)  -  /  e"^*'  I 

o 

etc. 

The  continuity  of  the  process  X(t)  ensures  the  existence  of  these  transforms. 

3.  The  distribution  of  T.  In  this  section  we  obtain  the  distribution  of  T 
In  terms  of  the  transition  density  £  of  the  process.  Theorem  3*1  for  the  one 
sided  barrier  Is  due  to  ^>legert  [l6]  essentially. 

Theorem  3.1.  If  X(t)  satisfies  conditions  A)  and  B),  then 
p(x  I  y,  A)  is  a  product 
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o 

p(x  I  7$  M 


u(x)u^(y) 

v(x)vj^(y) 


y  >  X 

y  <  X 


X  <  c 

X  >  c 


W«  note  th&t  abaorption  may  be  uncertain  and  f  (x  |  0)  - 

6 

Pr  <00^  may  be  leas  than  1*  A  neeeaaary  and  aufficient  condition 

that  abaorption  be  certain  ia  that  f  (x  |  O)  *  1* 

c 

To  prove  the  theorem  we  use  a  renewal  principle  which,  according  to 
Fortet,  goea  back  to  0,  Andre*  W#  have  by  A)  and  B)  for  y  >  c  >  x 

t 

p(x|y,  t)  -  y*  f-(x|tOp(c  I  y,  t-'T^dr 
0  ® 

by  a  direct  enumeration  of  the  prths  going  fWn  x  to  y.  On  taking  Laplace 
trane  forme  we  obtcJji 

I  7#  M  ■  ?g(x(  X)p(c  j  y,  X)  ,  y  >  c  >  X 

and  thus  p(x  |  y,  X)  is  a  Amotion  of  x  times  a  function  of  y,  say  u(x)u^(y) 
and  hence  for  y  >  c  >  x  we  get  f-(x|  X)  ■  '*^*Vu(o).  Similarly,  for 

V 
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y  <  c  <  X  w«  obtAin  f  (x  |  \)  -  /  v(c)  and  hence  for  any  C|  x  we  obtain 

the  concluaiona  to  the  theorea.  Finally  it  follows  by  cancelling  any  factor 
which  depends  only  on  X  that  u(x)  and  v(x)  are  uniquely  determined. 

Theorem  3.2.  Let  X(t)  satisfy  A)  ana  L)  and  let  the  functions 
u(x)  and  v(x)  be  as  in  theorea  3.1.  Then 

(3.2)  ^ab^xU)- 

(3.3) 

(3.4)  ^ab^*l  " 

To  prove  the  theorem  we  consider  the  two  expressions 

It) .  (x|  t)  r  (x|-c)f^(b  it-Ddt- 

o 

It)  •  ^Ib  ^*1  *•)  |t-tjdr 

O 

which  are  established  by  a  direct  enumeration. 

Considering  f*  and  f”  as  unknown  this  pair  of  simultaneous 
integral  equations  is  solved  immediately  by  taking  Lrplace  transforms 

(3.5)  \U  I  X)  .  f*|^(x  I X)  ♦  f"^(x  I  x)f^(b  I  X) 


(3.6)  f^(x  I  X)  -  f"^(x  (  X)  •»  f*^(x  I  X)fj^(a  I  X) 
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which  are  2  linear  equatlona  in  2  unknowns.  On  using  the  expressions  in 
theorem  3*1  for  f^  and  f^  we  get  (3*2)  and  (3.3)  for  f^^  and  f^^  and  the 
last  expression  (3.4)  is  obtained  lyy  noting  f^^  ■  f*^  ♦  f”^  • 

A  rarulom  variable  closely  related  to  T  is  the  maxlmxm  of  X(t), 
and  we  define 

(3.7)  M(x,  t)  -  sup  |X(X0  I  ,  X(0)  -  x 

0  <r<  t 

Denoting  the  dlatrlbution  of  M  by  G(x|  t)  we  have  clearly 

(3.8)  0{x  I t)  -  Pr  [m(x,  t)  <  5}  -  Pr  .  j(*)  >  »•  j 

-  1  -  .-(xl  t)  ,  S>l  *1 

80  that  the  distribution  of  M  is  given  directly  through  that  of  T.  On 
taking  Laplace  transforms  of  (3.8)  we  obtain  the  following  corollary 

CoroUciy  3.3  S(x  1 5,  X)  -  J 

for  ^(x  I  X)  as  in  theorem  3.2. 

^,-5 

For  a  symaetrical  process  there  is  a  specially  simple  formula 

for  the  Laplace  transform  of  T  (x).  A  process  X(t)  is  symmetrical 

a,-a 

if  p(x  I  y,  t)  ■  p  (-x  I -y,  t)  for  all  x,  y,  t.  In  this  case  u(x)  -  v(-x) 
and  theormi  3.2  yields  the  following  corollary 
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Corollary  1^4*  For  a  symmetrical  process 


(3.9) 


|x|  <  a 


4.  A  differential  equation.  The  function  p(x|  y,  \)  will  in  most  cases  of 
interest  satisfy  the  so-called  diffusion  equation 

dx 

with  initial  and  boundary  conditions  p(a)|y,  t)  -  p(- oojy,  t)  -  0, 
p(x  I  y,  O)  -  S(x-y)  (the  Dirac  function).  Sufficient  conditions  on  p, 
involving  the  infinitesimal  transition  moments »  are  known  in  order  that  p 
satisfy  (4.1)  and  ensure  the  process  is  continuous  with  probability  one 
(cf,  Doeblin  QJ  ),  When  A  and  B  are  given  ^  priori,  conditions  on  them 
are  known  which  ensures  that  (4,1)  has  a  unique  solution  which  is  the  transi¬ 
tion  density  of  a  process  continuous  with  probability  1,  (cf,  Fortet  ), 

But  general  necessary'  arxl  sufficient  conditions  are  not  known,  and  it  does 
not  appear  to  be  known  whether  a  process  continuous  with  probability  one 
satisfies  a  diffusion  equation.  However,  for  specific  processes  these  points 
are  generally  easy  to  resolve. 

The  following  theorem  shows  that  for  processes  satisfying  (4,1) 
and  y  can  be  determined  from  a  differential  equation. 

Theorem  4 Jl.  if  p(x  |  y,  t)  satisfies  (4.1)  and  X(t)  is  continuous 
with  probability  one,  the  functions  u(x)  and  v(x)  can  be  chosen  as  any  two 
linearly  independent  solutions  of  the  differential  equation 


4 

i 
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(4.2) 


^  B^(x)  ^  ♦  A(x)  ^  -  Aw 
dx 


0 


To  prove  the  theorem  we  note  that  if  p  satisfies  (4.1)  its 
Laplace  transform  satisfies 


(4.3) 


dx 


1 

2 


dx^ 


and  indeed  -  p  is  the  Green's  solution  to  this  equation  over  the  infinite 
Interval  (-oo  <  x  <  oo).  As  a  consequence,  if  u(od)  -  v(-oo)  •  0  and  u(x), 
v(x)  satisfy  (4.3)  we  obtain  to  a  constant  factor 


P(x  |y,  A) 


v(x)u(y) 

v(y)u(x) 


y  ^  X 
y  <  X 


so  that  wo  obtain  the  previous  expression  (3.1)  for  f  (x  |  \)  and  consequently 

0 

we  obtain  (3.2),  (3.3)  and  (3.4).  But  since  (3.2),  (3.3)  and  (3.4)  are  Invariant 


under  any  non-singular  linear  transformation  of  ^  and  ^  we  obtain  theorem  4.1. 

As  for  (3.9)  we  can  choose  for  u(x)  any  solution  to  (4.2)  provided  ^ 

u(x)  and  u(-x)  are  linearly  independent. 

The  customary  way  to  obtain  the  first  passage  probability  f^^j(x  I  t) 

is  to  solve  (4.1)  with  the  boundary  conditions  p(a  (  y,  t)  ■  p(b  |  y,  t)  -  0, 

a 

p(x  |y,  O)"  8(x-y)  and  then  we  shoxild  have  y-v(x  (  t)  -  1- y'  p(x  |  y,  t)  dy 

^  b 

(cf.  Fortet  for  a  proof  and  Levy  [l4^  for  a  general  discussion).  By 

A 

using  the  Laplace  transform  method  this  will  give  (3.4)  for  fg^^j(x  I  A)  -  but 
it  does  not  appear  to  give  f  and  f  • 
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M 

I 


jitico  I  O)  is  the  probability  that  absorption  in  the  barrier  a 

occurs  before  absorption  in  b,  we  should  expect  tint,  putting  \  ■  0  in  (4.2), 
the  solution  to 


with  ^  (a)  ■  1,  ^  (b)  -  0  should  give  this  probability.  Khintchine  Q33 
proved  this  result  ^lirectly  from  the  limiting  case  of  a  Markoff  chain  without 
the  use  of  a  stochastic  process,  barnard  C3]  has  considered  this  result  in 
connection  with  a  sequential  analysis,  problem, 

5.  A  few  examples. 

a)  The  b iener-binstein  process.  Here  X(t)  is  the  free  brownian 
motion;  X(t)  is  Gaussian  with  mean  0  and  covariance  l(x(8  )X(t))  ■  rain  (s,t) 
and  its  trc'Uisition  density  p  satisfies  the  differential  equation 

^  (i.e,  A  “  0,  8“  -  1  },  Two  linearly  independent  soli*  ions 

to  “  1^.  ■  -  \  -  0  are  u(x)  ■  e  ^  v(x)  ■  ^  -  u(-x)  and  hence  we 

obtain  from  (j.9) 

(5.1)  ?  ,(xA)  -  ,  |x|<a 

^  cosh  'y/Ix  a 

The  inversion  of  this  Laj^luce  transform  is  easy,  and  we  obtain 


% 
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r.,.a(x|  t)  -1  g  {(J^) 


and  by  integration  on  t 


This  completely  solves  the  caae  of  Brovflaan  notion  for  general  barriers,  since 


(5.2)  ''a.b  (*l  a;!;  (* 

,  2  »  "  2 
» 

t 

I  This  result  is  well  known  (Bachelier  [^2^  ,  Levy  [l/Q  )  and  is 

t 

t 

1  generally  obtained  by  the  method  of  images  with  the  heat  equation 

t 

^  1  a^D 

2  ax2 

t 

b)  The  Uhlenbeck  process.  Here  X(t)  is  stationary,  Markoffian, 
and  Gaussian,  with  mean  0  and  covariance  E(X(8)X(t))  •  e"^®”^^and  the 

!  /  X  2 

[  transition  density  satisfies  (4.1)  with  B  -  1,  A  -  -  x,  bolutions  to 

\w  ■  0 
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are  u(x)  -  fT^  where  i* 

the  V.eber  function  -  cf.  Iwhlttakor  and  Batson  CisJ  .  Hence  (3*9)  gives 


(5.3)  ^  (“ 


2 

2  ♦ 

2 


^2.  D_^(/V^  x) 

^  a)^D  (-V2  a) 


but  it  appears  very  difficult  to  invert  this  transform.  For  the  particular 
case  X  ■  0  this  result  (5.3^  was  obtained  from  a  lijaiting  case  of  an  Ehrenfest 
urn  scheme  describing;  molecular  equilibrium  by  Bellman  and  Harris  W- 


c)  A  Problem  of  Wald  Iji  sequent ial  analysis .  Let  X^,  X^,  ...  be 
independent  random  variables,  normally  dlstid-buted  with  an  unknown  mean  0 

2  m 

and  a  known  variance  K  ,  That  is,  the  density  of  is 


.,L  ■ 

K 


.  ^ 


According  to  the  sequential  likelihood  ratio  test  of  Wald,  in  order  to  test 
the  hypothesis  that  0-0^  against  the  hypothesis  0  ■  0^  we  consider 
random  variables 


Z 


i 


log  7ry  n"\  ■  — U. 


) 


and  let  Cj  -  Z^^  ♦  Z^  ♦  •••  *  •  Then  for  a  >  0  >  b  we  study  the  random 

variable  N  defined  as  the  smallest  integer  for  which  either  >  a  or  Sj^  <.  b 
and  determine  for  this  N  the  probabilities  of  these  outcomes. 


Now 
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(5.4) 


E(Z^) 


(5.5) 


Var(Z^) 


(-V^) 


so  that  this  suggests  we  study  a  Gaussian  process  S(t)  with  independent  incre¬ 
ments  and  with  £(S(t))  ■  pt  and  Var  (S(t))  •  o^t  (a  linear  transformation  of 
the  Wiener  process).  Then  the  Joint  distribution  of  S^,  •••,  is  the 

same  as  the  Joint  distribution  of  3(1) ,  3(2)^  •••  3(j),  and  in  place  of  find¬ 
ing  the  distribution  of  N  we  approximate  to  it  by  finding  the  distribution  of 
the  absorption  time  T.  .  (O)  in  connection  with  the  process  3(t),  It  should  be 

A I D 

remarked  that  the  nature  of  this  approximation  is  quite  different  from  Wold's 
approximation  of  "neglecting  the  excess"  since  the  process  S(t)  may  leave  and 
re-enter  one  of  the  barriers  between  two  consecutive  integer  time  instants. 

The  differential  equation  satisfied  by  the  transition  density  p  of 
the  process  S(t)  is 

at  ^  dx  2^2 

ox 

\ 

« 

that  is  A  ■  p,  j  and  (4.2)  becomes 


2  .2 

2  2 
dx*^ 


dx 


-  \w 


(5.6) 
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It  la  simple  to  solve  this  equation  with  constant  coefficients  and  since 

2  2 

the  two  roots  of-^^  are 

^1  2 
a 

r  .  -u-n/ 

52  •  2 

o 


two  linearly  independent  solutions  to  (5 *6)  are  u(x)  ■  e 
and  hence  by  theorem  3.2  we  immediately  obtain  f  >  r  »  and  f 
is  formally  solved.  The  expressions  are  to  be  considered  for 
gives  for  X  •  0,  with  this  u(x),  v(x), 


and  v(x)  ■  e 
and  the  problem 
x  •  0,  and  (3.2) 


f*(o  U) 


e  -  e 


and  at  X  -  0  this  gives  the  |.robability  of  being  absorbed  into  the  barrier  a 
before  b,  and  we  abbreviate  L*  (O)  ■  ^*^(0  |  0)  for  this  probability.  For 


X  ■  0  we  have  5l  "  ^  ^  ®  ®°  that 


(5.7) 


i\q) 


2 

.  °  -1 


-  e 


According  to  the  test  of  Wald  we  should  choose  the  barriers  a  and  b 
so  that  L^(Oj^)  ■  1  -  p,  ^^(O^)  ■  a  where  a  ,  p  are  given  positive  numbers  with 
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/ 

I 

2  2 
o  ♦  0  <  I  •  For  9  "  v§  have  2^  -  o  and  for  0  •  0^  have  2|i  •  -  o 

from  (5.4)  and  (5.5) .  Hence  from  (5»7)  we  get  as  two  equations  for  A  and  ^ 


si  -  |3 


which  are  easily  solved  to  give 
1 


a  ■  log 


b  -  log 


1-0. 


These  are  the  formulas  of  Wald* 

20  -  (0,^0  ) 

From  (5*2)  and  (5 •3)  we  see  that  ^  q  ^  whidi  denote  by 

0^  "  ^2 

h(0).  Then  setting  A  -  »  B  ■  we  obtain  from  (5»7) 


l"(o) 


-h(8) 


B 


the  probability  of  absorption  in  the  barrier  a,  which  is  the  power  of  the 
test  (l*e.  the  probability  of  rejecting  0  ■  0^  when  0  is  the  true  mean) 
and  1  -  L*(0)  •  L“(0)  is  the  expression  given  by  ^ald  for  the  operating 
characteristic  of  teet* 

For  the  distribution  of  T  (approxljaate  number  of  observations  necessary 
to  terminate  the  test)  we  use  the  expression  (3*4)  with  x  ■  0  to  give 


/ 
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-\T  ,  (0)  . 

E(e  )-f^^^(0U) 


/  ^2^  V  ,  ll®  ^2*. 

ijL — >  f  ^  ;-i^g  ,-"  ^ i 

V  ^  *  ^1* 


-  e 


which  can  be  inverted  to  give  a  rather  conplicated  expression. 


F  Jo  1 1)  .  Pr  [t  JO)  <  t  ] 


2 


M 


(a-b)  n-1  ^  a  n  n  ^ 

2<?  2(a-b)^ 


—  w  w*«e  %_ 

a-b  ^ 


.  (  2  2_2_2 

®  exp  ^-t  1  ^ 


2o^  2( 


Si) 


But  the  moments  are  easy  to  obtain  by  expanding  about  \  >  0,  since  we 

• 

have  the  moment  generating  function  of  T  (note  that  T  is  a  proper  random 

variable  -  i.e,  absorption  is  a  certain  event  since  f^^  (o(0)  ■  1  )•  An 

alternative  way  is  to  use  the  result  of  the  next  section  which  gives  the 

moments  as  the  solutions  to  differential  equations.  If  we  let  m(x)  ■ 

E(T  .  (x))  then  from  (6.6)  it  follows  that  m  satisfies  the  differential 
ao 

equation 


2 

^  m"  (x)  ♦  p  m'(x)  -  -  1 


with  m(a)  -  m(b)  -  0  . 

Assuming  first  the  p  /  0  we  obtain  by  solving  this  equation 
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m(0)  -  £(T)  -  kaL*iQ)  ♦  bL“(e)) 
while  for  ^  •  0 

E(T)  -  -  log  C-^)  log  (^)  - ^ — 5 

0^  “  "  (e^-ep^ 

H«r«  L~(0)  ■  1  -  L^(d)  is  the  probability  of  absorption  in  the  barrier  b, 

2 

and  a,  b,  o  have  their  former  significance. 

It  is  rather  remarkable  that  despite  the  differing  nature  of  the 
approximations  of  Wald  and  the  approximations  by  presuming  a  continuous 
process  aa  here,  they  should  give  the  same  fomulas. 

d)  A  nonoarametrlc  test  in  *  goodness  of  fit . '  In  a  test  related 
to  the  Kolmogoroff-Smimov  teste  the  follovdng  important  absorption  probability 
problem  arose:  if  X(t}  is  the  Uhlenbeck  process  (cf.  example  b)  above) 
calculate  the  probability 

b(5lt)  -  Pr|^U(t)|  <  §,  0<f<t  j 

where  X(0)  has  its  stationary  distribxition.  Thus  we  have  the  problem  of 
finding  the  distribution  of  the  random  variable  M(Xf  t)  defined  by  (3*7) 
whose  distribution  function  is  0(x  |  t)  as  in  (3.8). 

For  I  X  I  <  ^  we  have  0(x|  t)  •  1  -  I  since  for 

I X I  ^  ^  we  have  G  >  1  we  define  F  •  0  for  I  x  |  ^  'g  •  The  stationary  distribution 


\ 
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of  X(t)  is  N(0,  1),  !•••  has  a  danslty  fi(x)  ■  ^  and  hanca 

b(rl^)  ^(x)G(x|^  t)dx  -y'  ^(x)P  .Jxl  t)dx 

-  00  -  00  3*  5 


On  taking  Laplace  transforas  we  get 


and  substituting  from  (5*3)  wa  have 

^  2 

/  •"*  (u^(V2»)»Djj^(-VSc))d)tj 

This  result  was  given,  without  proof,  in  W 

a)  T|lS  optional  stopping  problem.  In  ^10  Kobblns  outlined  the 

optional  stopping  problem.  Let,  as  in  example  c)  above,  the  problem  be  that 

2 

of  tasting  the  mean  of  a  normal  universe  with  known  variance,  saj  a  ,  but 
instead  of  testing  the  hypotheses  and  of  example  c)  we  have  the  hypothesis 
0  ■  0  to  test  against  0  /  0  (Robbins  considers  0  >  0),  As 
sketched  by  Robbins  the  basic  problem  is  to  calculate  the  probability,  when 
©  -  0, 


.(^IX)  .1^1-  V|- 


g( 


n^,  n^,  a)  -  Pr  [iS^I  <  00  <  n  <  n^^ 


for  given  a,  n^  and  n^.  For  the  case  of  instead  of  |  S^|  Hobbine  gave 
an  inequality,  and  here  we  give  an  approximate  and  an  asymptotic  result. 
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Th«  randcQ  variabl«i  j  ,  n  ■  ♦  1,  •••, 

have  mean  0,  variance  1,  are  normally  distributed  and  form  a  Markoff 
chain  with  covaz*iance 


[ 


0^/n  Vjn 


Hence  the  Joint  distribution  of  them  is  the  same  as  the  Joint  distribution 
of  X(^  log  n^),  X(^  log  (nj^^l))  ,  •••,  X(i  log  n^)  where  X(t)  is  the 

Uhlenbeok  proceaa;  cf«  examples  b)  and  d)  above.  Hence  we  have,  using 
approximations  like  those  in  example  c),  that 


g(n^,  n^,  o)  -  Pr  X(t)  |  <  a,  ^  log  n^^  <  t  <  |  log  n^  j 


-  b(o  I  I  log 

1 


where  b(^  |  t)  is  the  function  of  example  d)  and  of  which  we  have  the  Laplace 
transform. 

It  is  also  possible  to  give  an  exact  asymptotic  result  which  is 

applicable  even  if  the  variables  have  not  got  a  normal  distribution  but 

merely  have  mean  0,  variance  o  ,  and  obey  the  central  limit  theorem  (e.g. 

”l 

if  they  are  identically  distributed^  Let  n^  oo,  >^2  •  n* 

0  <  t  <  1  and  consider  a  sequence  "  ”l'  ^  •••»  *^2 

for  fixed  **2  ^  sequence  depends  upon  $  and  for 


n2  00  becomes  everywhere  dense  in  the  interval  t  <  1.  That  is, 

fiven  any  ^(t  <  tr<  Ij  we  can  chooce  an  element  from  s'^ch  that 

lini  z--t: 

k  -»a> 


Then  since 


fi(n, ,  n  ,  a)  -  Hr 


I 

V  o 


*-  a 


vr . 


<  n  <  ^ 


it  will  follow  from  a  theorem  of  Donsker  that  the  limiting  distribution  g 

can  be  expresricd  as  the  distribution  of  the  corresponding  Wiener  functional, 

^1 

Hence  for  n,  -»»ao,n^-^oo,  -®-^t,  0<t<vl, 

,L  A, 

o)  Pr^|v/(^0|  <  a/\/r  ,  t  <  1  | 


where  W(t)  is  the  WieneivEinstein  process  (cf.  example  a)  above). 

Now  if  X(t)  is  the  Uhlenbeck  jirocess  (cf,  example  b)  )  we 
can  write  t*(t)  »  (Doob  ^8^  )  and  thus 


lim  g  •  Hr  1^1  2  Tob  I  ^  ll  ^  | 

-  Hr  |^U(TO|<a,  0<  b(a|  ^log 


n. 


n. 


1  b.  ...  .  /  I  1 

1 

expression  deduced  ^bove.  It  seeras  somewhat  striking  that  these  two 


am  since  f  =  lim  wo  obtain  gv^b(u|  r  log  —)  ,  the  approximate 

w  ic 


expressions  should  agree,  being  deduced  from  essentially  distinct  principles. 


6,  Uji  the  moments  oJ[  T,  In  the  preceding  work  the  dlctrlbutlons  were  generally 
expressed  as  Laplace  transfoms  which  ari  often  difficult  to  Invert  but  which 
give  immediate  information  about  the  moments  of  T, 

In  the  present  section  we  suppose  that  rr  <  oo  ^  ■  1,  i.e.  that  T 
is  a  proper  random  variable,  as  otherwise  the  moments  v/ill  not  exist.  If  the 
corresponding  Laplace  transform  is  1  for  X  -  0  the  variable  is  proper.  Let  us 
put 


-  E(T^(x)) 


which  we  suppose  to  exist  for  n  <  n^.  We  have  by  a  series  expansion 


n  *(n)/  V 

o  t'  '(x;  n 


n 


(6.1)  ifjb^xU)-2Z  -  (-^)  •  o(E  °)  ,  \  0 


n-0 


n: 


A  *^o  t^*^^(x)  n  n 

f.(x|E)  -S-T -  (-X)  •  o(E  °)  ,  A.  0 

'  n-0 


for  which  the  moments  are  determined. 

From  equations  (3 •5)  and  (3*6)  it  is  possible  to  e^q^ress 

A  A+  _  A 

“f.  ♦f.in  terms  of  the  transforms  f  and  from  this  fact  we  can 
ab  ao  ab  c 

express  the  moments  t^^^  in  terms  of  the  one-sided  first  passage  moments 
^c*^^  •  in  fact  from  (3.5)  and  (3.6) 


f  Jx  I  \)  -  - f - 2 - a - 

f^(b|\}f^(a|\)-l 


and  it  follows  that  will  be  given  by  an  algebraic  corabination  of 

t^^^(x)  and  t|^'^^(x)  for  h  <  n,  J  <  n,  provided  these  moments  exist.  But 
it  should  be  remarked  tfiat  exist  in  general  for  finite  a,  b. 


(k), 


even  thoughi  t'  '(x)  nay  not,  as  the  simple  h'iener-Kinstein  proceas,  for 
c 

(ki 

which  t  ‘'(x)  ■  oo  for  k  >  1,  shows, 
c  ~ 

In  particular  for  a  -  1,  where  we  put  t^^"^  “  t,  we  get  for  the 
mean  first  passage  tine  by  a  simple  expansion  of  (6,2) 


,,  ,,  ,  ,  ,  t.^(x)tpajnpx)t^(b).t^(b)tpa) 

*-ab<*^ - t"(b)'nj-a) - 

a  b 


This  formula  leads  to  interesting  consequences:  Let  a  arid 
b  be  such  that  t^(b)  -  t^(a).  Then  since  t^(a)  ■ 

(6,3)  becomes 

t  (x)-t  (a) 

(o,/i)  “  - 2 - 

The  right-hand  side  of  (6.4)  la  iniep-n  lent  of  b,  and  since  t  .(x)  ^  0  we 
have  the  result  that  when  a  >  x  >  b  and  t  (b)  «  ^u^^)  t,hen  t  (x)  ^  t  (a). 

Thus  it  is  possible  that  the  mean  len(^h  of  time  to  go  fron  a  less  probable 
state  to  a  more  probable  state  for  the  fir..t  tine  is  longer  than  to  reverse 
the  journey  -  a  result  which  at  first  sight  seens  paradoxical.  It  is  simple 


to  construct  processes  for  which  this  result  obtains. 
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It  is  possible  also  to' express  the  probability  of  absorption  in 
the  barrier  a  before  b  by  means  of  the  one-sided  first  passage  moments, 
bince  is  this  probability  we  obtain  from  (3.5)  and  (3«6) 


(x  I  \) 


f^(bU)f^^(x|\)-f^(x|\) 

f^(a|\)f^{b|\)-l 


hence  letting  X  0  we  obtain  the  conclusion  that  ijf  the  first  passaf^e  moments 
exist  the  probability  of  absorption  in  a  before  b  driven  by 


bince  the  expressions  f,  f  ,  and  f  satisfy  the  differential 
equation  (4.2)  if  the  corresponding  transition  density  p  satisfies  (4.1) 
it  is  possible  to  find  the  moments  t^*^^  directly  through  a  differential 
equation,  and  this  often  affords  a  more  computationally  feasible  method 

A 

than  a  direct  evaluation  of  f  .  have  in  fact  the  following  theorem. 

Theorem  6.1.  Let  4(t)  satisfy  the  hypotheses  of  theorem  4.1. 
Then  if  T  ■  T^^^(x)  is  a  proper  random  variable  whose  moments 
of  order  n  <  n^  exist  t^^^  »  L^|^^(x)  satisfies  the  system 


(6.5) 


i  n2  dV"^ 


B' 


♦  A 


dt 


(n) 


dx 


dx 


-  nt 


(n-1) 


t^®*^  -  1 


n  <  n 

-  0 


* 


n  >  0 
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To  prove  the  theorem  we  merely  substitute  the  expansion  (6,1}  in 


the  differential  equation  (4,2)  and  equate  the  coefficient  of  to  zero. 

The  system  (6,5)  is  particularly  easy  to  solve  since  the  substitution 

(n) 

Z'  '  -  — renders  each  equation  linear  of  the  first  order,  and  the  solution 

can  be  written  inunediately  in  quadratures,  dtartlng  with  n  -  1  each  t^*^^  can 

(k) 

be  obtained  in  turn  in  quadratures  from  the  previous  t'  '(k  <  n) ,  In  particular 


for  n  ■  1  we  have 


(6,6) 


2“  '‘dx  1- 


t(a)  ■  t(b)  -  0  , 


a  result  we  have  used  already  in  sec,  5  example  c), 

7,  The  ran/!e  of  In  this  section  we  develop  a  formula  for  the  distri¬ 

bution  of  the  random  variable 


H(x,  t)  ■  sup  -  inf  ^(“^ 

0  0  <  r<  t 

which  is  called  the  ran^e  of  A(t),  or  the  oscillation  of  X(t),  and  we  denote 
its  distribution  by  J(x  |  r,  t)  »  Pr  |ji(x,  tj  r|  ,  Note  that  this  probability 
exists  if  X(t)  satisfies  conditions  A)  and  B)  of  section  2, 

A  treatment  of  the  ivuidom  variable  H  for  the  Alener-Einsteln  case 
has  been  made  by  Feller  [[lo]]  in  a  statistical  application,  and  the  present 
section  solves  a  problem  he  posed  on  finding  the  distribution  of  R  for  other 


processes. 
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Again  we  presiine  the  existence  of  a  density  for  R,  say 
I  r,  t)  -  {(x  Ir,  t)  only  to  expedite  the  analysis.  It  is  not 

difficult  to  show  that  the  existence  of  a  density  for  T  implies  that  for  R. 

Theorem  7.1.  Let  A(t)  satisfy  conditions  A)  and  B)  and  let 
j^(x  I  r,  t)  be  the  density  of  R(x,  t).  Then  for  |  A)  as  in  (3.4) 

we  have 


(7.1)  ^(x  I  r,  A)  - 


x*^ 

.2  2 


-  i  -2-  r  f 

A  -  2  ''  r  r 

x-i  ''*2*  ''*2 


(x  I  A)dv 


We  note  that  f(x  |  r,  A),  being  merely  j((x  \  u,  A)du  is 

0 

given  immediately  since  ^  is  expressed  as  a  derivative. 

The  starting  point  of  the  proof  is  the  formula 


^(x  I  r,  t)  -  /  1^- 


dadb 


O-i'.bUl  t))]  db 
a-b+r 


which  is  established  readily  by  an  enum  .ration  of  cases.  The  existence  of 
the  derivative  (under  the  integral  sign)  follows  from  the  existence  of  the 
density  of  A(t)  at  a  and  b,  for  when  S>  0 


I  -  Vg.b^*  I 

-  Pr  <  X(t)  <  a  S  ,  A(r)  >  b,  0<Z<t'^ 

On  taking  the  Laplace  transform  of  the  preceding  expression  (which 
can  be  done  under  the  integration  and  differentiation  operations)  we  obtain 


X  r- 


flU  I  r,  .  i  /  I  ).)] 

x-r  a-b>] 


and  the  conclusions  to  the  theorem  follow  by  notini^  the  identity 


ia)b  ^ab^^  ' 


a-b^r 


-  _j _ 

Jbdr 


-  77  Vr,b‘*  ' 


As  an  application  we  consider  the  ’..ienej>-Kinstein  process  for  which 
we  hive  shown  (  (5«1)  and  (5«-^)  ) 


*  cosh/V^ 

f  ^(xU) - ^ 

=“>  coshv^  (^) 


and  here  (7»1)  gives  on  performing  the  integration. 


^(x  I  r,  tanh 

dr^ 


indeporxlent  of  x  since  tnc  process  is  sj^atially  homogeneous. 

This  latter  transform  is  e  -sy  to  invert,  and  we  have 


^{x  I  r 


,  2  (  f-  1  . 

,  t;  -  -  I  ^  2_  — 7  e^{H-  - 3 -  ) 

L  JK)  ,,a‘' 


/\4Int  J-1 


-29- 


these  two  expressions  beinj;  related  by  Theta  function  identities,  and  the 
second  being  given  by  Feller  [_lo]  • 

For  the  maaents  we  get  from  (7.2)  immediately 

e(r")  .  0 
'  '  n 


where 


c  - 

n 


^n/2 

r(f*i) 


00 


,2 


v./*  p  tanh  p  dp 

o  dp 


30  that,  e.g,,  E(R)  -VSt/n  ,  Ei(R^)  -  4t  log  2,  etc. 
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